Masked Face Recognition Model with Explainable AI

Due to the recent COVID-19 pandemic, people tend to wear masks indoors and outdoors. Therefore, systems with face recognition, such as FaceID, showed a tendency of decline in accuracy. Consequently, many studies and research were held to improve the accuracy of the recognition system between masked faces. Most of them targeted to enhance dataset and restrained the models to get reasonable accuracies. However, not much research was held to explain the reasons for the enhancement of the accuracy. Therefore, we focused on finding an explainable reason for the improvement of the model's accuracy. First, we could see that the accuracy has actually increased after training with a masked dataset by 12.86%. Then we applied Explainable AI (XAI) to see whether the model has really focused on the regions of interest. Our approach showed through the generated heatmaps that difference in the data of the training models make difference in range of focus. © 2023, The Author(s), under exclusive license to Springer Nature Switzerland AG.

Masked Face Recognition System using Extended VGG-19

The scientific community has observed several issues as a result of COVID-19, both directly and indirectly. The use of face mask for health protection is crucial in the current COVID-19 scenario. Besides, ensuring the security of all people, from individuals to the state system, financial resources, diverse establishments, government, and non-government entities, is an essential component of contemporary life. Face recognition system is one of the most widely used security technology in modern life. In the presence of face masks, the performance of the current face recognition systems is not satisfactory. In this paper, we investigate a flexible solution that could be employed to recognize masked faces effectively. To do this, we develop a unique dataset to recognize the masked face, consisting of a frontal and lateral face with a mask. We propose an extended VGG19 deep model to improve the accuracy of the masked face recognition system. Then, we compare the accuracy of the proposed framework to that of well-known deep learning techniques, such as the standard Convolutional Neural Network (CNN) and the original VGG19. The experimental results demonstrate that the proposed extended VGG19 outperforms the investigated approaches. Quantitatively, the proposed model recognizes the frontal face with the mask with high accuracy of 96%. © 2022 IEEE.

Framework for biometric iris recognition in video, by deep learning and quality assessment of the iris-pupil region

In the current world scenario the influence of the COVID19 pandemic has reached universal proportions affecting almost all countries. In this sense, the need has arisen to wear gloves or to reduce direct contact with objects (such as sensors for capturing fingerprints or palm prints) as a sanitary measure to protect against the virus. In this new reality, it is necessary to have a biometric identification method that allows safe and rapid recognition of people at borders, or in quarantine controls, or in access to places of high biological risk, among others. In this scenario, iris biometric recognition has reached increasing relevance. This biometric modality avoids all the aforementioned inconveniences with proven high efficiency. However, there are still problems associated with the iris capturing and segmentation in real time that could affect the effectiveness of a System of this nature and that it is necessary to take into account. This work presents a framework for real time iris detection and segmentation in video as part of a biometric recognition system. Our proposal focuses on the stages of image capture, iris detection and segmentation in RGB video frames under controlled conditions (conditions of border and access controls, where people collaborate in the recognition process). The proposed framework is based on the direct detection of the iris-pupil region using the YOLO network, the evaluation of its quality and the semantic segmentation of iris by a Fully Convolutional Network. (FCN). The proposal of an evaluation step of the quality of the iris-pupil region reduce the passage to the system of images with problems of out of focus, blurring, occlusions, light changing and pose of the subject. For the evaluation of image quality, we propose a measure that combines parameters defined in ISO/IEC 19794-6 2005 and others derived from the systematization of the knowledge of the specialized literature. The experiments carried out in four different reference databases and an own video data set demonstrates the feasibility of its application under controlled conditions of border and access controls. The achieved results exceed or equal state-of-the-art methods under these working conditions.

Masked Face Recognition Using Multi-Task Cascaded Convolutional Networks and FaceNet

Face masks have been widely used since the start of the COVID-19 pandemic. Facial detection and recognition technologies, such as the iPhone's Face ID, heavily rely on seeing the facial features that are now obscured due to wearing a face mask. Currently, the only way to utilize Face ID with a mask on is by having an Apple Watch as well. As such, this paper intends to find initial means of a reliable personal facial recognition system while the user is wearing a face mask without having the need for an Apple Watch. This may also be applicable to other security systems or measures. Through the use of Multi-Task Cascaded Convolutional Networks or MTCNN, a type of neural network which identifies faces and facial landmarks, and FaceNet, a deep neural network utilized for deriving features from a picture of a face, the masked face of the user could be identified and more importantly be recognized. Utilizing MTCNN, detecting the masked faces and automatically cropping them from the raw images are done. The learning phase then takes place wherein the exposed facial features are given emphasis while the masks themselves are excluded as a factor in recognition. Data in the form of images are acquired from taking multiple pictures of a certain individual's face as well as from repositories online for other people's faces. Images used are taken in various settings or modes such as different lighting levels, facial angles, head angles, colors and designs of face masks, and the presence or absence of glasses. The goal is to recognize whether it is the certain individual or not in the image. The training accuracy is 99.966% while the test accuracy is 99.921%. © 2022 IEEE.

Longitudinal Analysis of Mask and No-Mask on Child Face Recognition

Face is one of the most widely employed traits for person recognition, even in many large-scale applications. Despite technological advancements in face recognition systems, they still face obstacles caused by pose, expression, occlusion, and aging variations. Owing to the COVID-19 pandemic, contactless identity verification has become exceedingly vital. To constrain the pandemic, people have started using face mask. Recently, few studies have been conducted on the effect of face mask on adult face recognition systems. However, the impact of aging with face mask on child subject recognition has not been adequately explored. Thus, the main objective of this study is analyzing the child longitudinal impact together with face mask and other covariates on face recognition systems. Specifically, we performed a comparative investigation of three top performing publicly available face matchers and a post-COVID-19 commercial-off-The-shelf (COTS) system under child cross-Age verification and identification settings using our generated synthetic mask and no-mask samples. Furthermore, we investigated the longitudinal consequence of eyeglasses with mask and no-mask. The study exploited no-mask longitudinal child face dataset (i.e., extended Indian Child Longitudinal Face Dataset) that contains 26,258 face images of 7,473 subjects in the age group of [2, 18] over an average time span of 3.35 years. Due to the combined effects of face mask and face aging, the FaceNet, PFE, ArcFace, and COTS face verification system accuracies decrease by approximately , , , and , respectively. © 2022 ACM.

Efficient intelligent compression and recognition system-based vision computing for computed tomography COVID images

Computed tomography (CT) image-based medical recognition is extensively used for COVID recognition as it improves recognition and scanning rate. A method for intelligent compression and recognition system-based vision computing for CT COVID (ICRS-VC-COVID) was developed. The proposed system first preprocesses lung CT COVID images. Segmentation is then used to split the image into two regions: nonregion of interest (NROI) with fractal lossy compression and region of interest with context tree weighting lossless. Subsequently, a fast discrete curvelet transform (FDCT) is applied. Finally, vector quantization is implemented through the encoder, channel, and decoder. Two experiments were conducted to test the proposed ICRS-VC-COVID. The first evaluated the segmentation compression, FDCT, wavelet transform, and discrete curvelet transform (DCT). The second evaluated the FDCT, wavelet transform, and DCT with segmentation. It demonstrates a significant improvement in performance parameters, such as mean square error, peak signal-to-noise ratio, and compression ratio. At similar computational complexity, the proposed ICRS-VC-COVID is superior to some existing techniques. Moreover, at the same bit rate, it significantly improves the quality of the image. Thus, the proposed method can enable lung CT COVID images to be applied for disease recognition with low computational power and space. © The Authors. Published by SPIE under a Creative Commons Attribution 4.0 International License. Distribution or reproduction of this work in whole or in part requires full attribution of the original publication, including its DOI. [DOI: 10.1117/1.JEI.32.2.021404] © 2023 SPIE. All rights reserved.

Emotion Detection of People Wearing Face Mask

Though many facial emotion recognition models exist, after the Covid-19 pandemic, majority of such algorithms are rendered obsolete as everybody is compelled to wear a facemask to protect themselves against the deadly virus. Face masks can hinder emotion recognition systems, as crucial facial features are not visible in the image. This is because facemasks cover essential parts of the face such as the mouth, nose, and cheeks which play an important role in differentiating between various emotions. This study intends to recognize the emotional states of anger-disgust, neutral, surprise-fear, joy, sadness, of the person in the image with a face mask. In the proposed method, a CNN model is trained using images of people wearing masks. To achieve higher accuracy, the classes in the dataset are combined. Different combinations of clubbing are performed, and results are recorded. Images are taken from FER2013 dataset which consists of a huge number of manually annotated facial images of people. © 2023 IEEE.

A Comprehensive Review on Access Control Systems amid Global Pandemic

In the contemporary time of technology, security is the utmost concern for every building automation system. Access Control Systems are the backbone of any security system being employed in any intelligent building, and can be operated in a biometric or non-biometric manner. There are various types of recognition systems available, depending upon the required level of safety and security. The ongoing pandemic has challenged and tested Access Control System in many aspects.This paper aims to review the various forms of access control systems and their viability in the context of COVID-19. It is found that some access control solutions fail to provide the required security during this global epidemic due to their contact-based operations. So, in the midst of the worldwide pandemic, a realistic integrated electronic access control system can be designed to meet the requirements of users. © 2022 IEEE.

Ensemble Learning using Transformers and Convolutional Networks for Masked Face Recognition

Wearing a face mask is one of the adjustments we had to follow to reduce the spread of the coronavirus. Having our faces covered by masks constantly has driven the need to understand and investigate how this behavior affects the recognition capability of face recognition systems. Current face recognition systems have extremely high accuracy when dealing with unconstrained general face recognition cases but do not generalize well with occluded masked faces. In this work, we propose a system for masked face recognition. The proposed system comprises two Convolutional Neural Network (CNN) models and two Transformer models. The CNN models have been fine-tuned on FaceNet pre-trained model. We ensemble the predictions of the four models using the majority voting technique to identify the person with the mask. The proposed system has been evaluated on a synthetically masked LFW dataset created in this work. The best accuracy is obtained using the ensembled models with an accuracy of 92%. This recognition rate outperformed the accuracy of other models and it shows the correctness and robustness of the proposed model for recognizing masked faces. The code and data are available at https://github.com/Hamzah-Luqman/MFR. © 2022 IEEE.

Generating Masked Facial Datasets Using Dlib-Machine Learning Library

In 2020, the COVID-19 pandemic spread globally, leading to countries imposing health restrictions on people, including wearing masks, to prevent the spread of the disease. Wearing a mask significantly decreases distinguishing ability due to its concealment of the main facial features. After the outbreak of the pandemic, the existing datasets became unsuitable because they did not contain images of people wearing masks. To address the shortage of large-scale masked faces datasets, a developed method was proposed to generate artificial masks and place them on the faces in the unmasked faces dataset to generate the masked faces dataset. Following the proposed method, masked faces are generated in two steps. First, the face is detected in the unmasked image, and then the detected face image is aligned. The second step is to overlay the mask on the cropped face images using the dlib-ml library. Depending on the proposed method, two datasets of masked faces called masked-dataset-1 and masked-dataset-2 were created. Promising results were obtained when they were evaluated using the Labeled Faces in the Wild (LFW) dataset, and two of the state-of-the-art facial recognition systems for evaluation are FaceNet and ArcFace, where the accuracy of using the two systems was 96.1 and 97, respectively with masked-dataset-1 and 87.6 and 88.9, respectively with masked-dataset-2. © 2022 IEEE.

Face Mask Detection Using Convolution Neural Network

Face recognition in the industry now is playing an important role in each sector. Each person has different type of features and face;therefore, each identity is unidentical. In this COVID outbreak, a major crisis has occurred due to which preventions are to be made. One such prevention is use of a face mask which is very much important. Nowadays, various firms and organizations are using facial recognition systems for their own general purpose. We all know that it has now been a crucial task to wear a mask every time, when we go somewhere. But as we know it is not possible to keep track of who wears a mask and who does not. We make the use of AI in our daily life. We achieve this with the help of a neural network system, which we train so that it can further describe people's features. Even though the original dataset was limited, the Convolutional Neural Network (CNN) model achieved exceptional accuracy utilizing the deep learning technique. With the use of a face mask detection dataset that contains both with and without face mask photographs, we are able to recognize faces in real-time from a live webcam stream using OpenCV. We will develop a COVID-19 face mask detection system using our dataset, along with Python, OpenCV, Tensor Flow, and Keras. © 2022 IEEE.

Face Mask Recognition System for Epidemic Prevention and Control Based on Multi-algorithm Fusion

Against the backdrop of the ongoing COVID-19 pandemic, We propose FMRS-CFR (Face mask recognition system-Centerface Resnet), a mask recognition system for epidemic prevention and control based on multi-algorithm fusion to adapt to multi-scenario applications. In this work, Centerface face key point detection and Resnet50 classification model were used. Built a system that maintains multi-adaptation with the dynamics of external scenarios and ported the system to the Atlas 200 Developer Kit, And quantitative evaluation of videos in more than a dozen different scenarios. Experimental results show that the FMRS-CFR system can achieve a recognition accuracy rate of 99.88%, which greatly improves the recognition rate of not wearing a mask or wearing the correct one to a certain extent, and achieves the purpose of effectively assisting epidemic prevention and control. © 2023, The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

A Systematic Literature Review on Human Ear Biometrics: Approaches, Algorithms, and Trend in the Last Decade

Biometric technology is fast gaining pace as a veritable developmental tool. So far, biometric procedures have been predominantly used to ensure identity and ear recognition techniques continue to provide very robust research prospects. This paper proposes to identify and review present techniques for ear biometrics using certain parameters: machine learning methods, and procedures and provide directions for future research. Ten databases were accessed, including ACM, Wiley, IEEE, Springer, Emerald, Elsevier, Sage, MIT, Taylor & Francis, and Science Direct, and 1121 publications were retrieved. In order to obtain relevant materials, some articles were excused using certain criteria such as abstract eligibility, duplicity, and uncertainty (indeterminate method). As a result, 73 papers were selected for in-depth assessment and significance. A quantitative analysis was carried out on the identified works using search strategies: source, technique, datasets, status, and architecture. A Quantitative Analysis (QA) of feature extraction methods was carried out on the selected studies with a geometric approach indicating the highest value at 36%, followed by the local method at 27%. Several architectures, such as Convolutional Neural Network, restricted Boltzmann machine, auto-encoder, deep belief network, and other unspecified architectures, showed 38%, 28%, 21%, 5%, and 4%, respectively. Essentially, this survey also provides the various status of existing methods used in classifying related studies. A taxonomy of the current methodologies of ear recognition system was presented along with a publicly available occlussion and pose sensitive black ear image dataset of 970 images. The study concludes with the need for researchers to consider improvements in the speed and security of available feature extraction algorithms.

Improving Masked Face Recognition Using Dense Residual Unit Aided with Quadruplet Loss

All over the world, people are wearing face masks and practising social distancing to protect themselves against the Coronavirus disease (COVID-19). The need for contactless biometric systems has increased to avoid the common point of contact. Among contactless biometric systems, facial recognition systems are the most economical and effective ones. Conventional face recognition systems rely heavily upon the facial features of the eyes, nose, and mouth. But due to people wearing face masks, the important facial features of the nose and mouth get hidden under the mask, resulting in degraded performance by the facial recognition systems on masked faces. In this paper, we propose a Dense Residual Unit (DRU) aided with Quadruplet loss on top of existing facial recognition systems. This solution tries to unveil the masked faces by producing embeddings for masked faces, which are similar to embeddings of unmasked faces of the same identity but different from embeddings of different identities. We have evaluated our method using two pre-trained facial recognition models' backbones, i.e. Resnet-101 and MobileFaceNet, and upon two datasets, among them, one is a real-world dataset, i.e. MFR2, and one is a simulated masked face dataset i.e. masked version of LFW. We have achieved improvement in the performance of masked face recognition in terms of False Match Rate, False Non-Match Rate, Fisher Discriminant ratio, and Equal Error Rate. © 2023, The Author(s), under exclusive license to Springer Nature Switzerland AG.

Localization using Multi-Focal Spatial Attention for Masked Face Recognition

Since the beginning of world-wide COVID-19 pandemic, facial masks have been recommended to limit the spread of the disease. However, these masks hide certain facial attributes. Hence, it has become difficult for existing face recognition systems to perform identity verification on masked faces. In this context, it is necessary to develop masked Face Recognition (MFR) for contactless biometric recognition systems. Thus, in this paper, we propose Complementary Attention Learning and Multi-Focal Spatial Attention that precisely removes masked region by training complementary spatial attention to focus on two distinct regions: masked regions and backgrounds. In our method, standard spatial attention and networks focus on unmasked regions, and extract mask-invariant features while minimizing the loss of the conventional Face Recognition (FR) performance. For conventional FR, we evaluate the performance on the IJB-C, Age-DB, CALFW, and CPLFW datasets. We evaluate the MFR performance on the ICCV2021-MFR/Insightface track, and demonstrate the improved performance on the both MFR and FR datasets. Additionally, we empirically verify that spatial attention of proposed method is more precisely activated in unmasked regions. © 2023 IEEE.

A fast face recognition system based on annealing algorithm to optimize operator parameters

In order to improve the recognition rate and operational efficiency of the system, a method in which the image features compensation coefficients are optimized by using an improved simulated annealing algorithm is proposed. Firstly, eight computational factors with low computational complexity are given, which can be used to compensate image features. Secondly, the design flow of face recognition algorithm is presented. Thirdly, an improved simulated annealing algorithm is designed to solve the optimal combination of feature compensation coefficients in the face recognition system. Fourthly, the results of the feature compensation coefficients recommended by the improved simulated annealing algorithm are applied to the Efficient Face Recognition Algorithm (EFRA) in this paper, and verified on the simulation platform. Experiments show that the recognition rate can reach 100% when the training images are 6 in ORL. The proposed algorithm also performs well in MU_PIE dataset. © 2023 The Author(s). Published by Informa UK Limited, trading as Taylor & Francis Group.

An Extensive Study on HAR Systems to Recognize Daily Activities using Deep Learning Approaches

"Human Activity Recognition" (HAR) refers to the ability to recognise human physical movements using wearable devices or IoT sensors. In this epidemic, the majority of patients, particularly the elderly and those who are extremely ill, are placedin isolation units. Because of the quick development of COVID, it's tough for caregivers or others to keepan eye on them when they're in the same room. People are fitted with wearable gadgets to monitor them and take required precautions, and IoT-based video capturing equipment is installed in the isolation ward. The existing systems are designed to record and categorise six common actions, including walking, jogging, going upstairs, downstairs, sitting, and standing, using multi-class classification algorithms. This paper discussed the advantages and limitations associated with developing the model using deep learning approaches on the live streaming data through sensors using different publicly available datasets. © 2022 IEEE

A Deep Learning Approach to Facial Expression Recognition in the Presence of Masked Occlusion

Detecting facial expressions is a vital aspect of interpersonal communication. Automatic facial emotion recognition (FER) systems for detecting and analyzing human behavior have been a subject of study for the past decade, and have played key roles in healthcare, crime detection, and other use cases. With the worldwide spread of the COVID-19 pandemic, wearing face masks while interacting in public spaces has become recommended behavior to protect against infection. Therefore, improving existing FER systems to tackle mask occlusion is an extremely important task. In this paper, we analyze how well existing CNN models for FER fare with masked occlusion and present deep CNN architectures to solve this task. We also test some methods to reduce model overfitting, such as data augmentation and dataset balancing. The main metric used to compare the models is accuracy, and the dataset used here is FER2013. Images from FER2013 were covered by masks using a certain transformation, resulting in a new dataset, MFER2013. From our evaluation and experimentation, we found that existing models need to be modified before they can achieve good accuracy on masked datasets. By improving the architecture of the base CNN, we were able to achieve a significantly improved accuracy. © 2022 IEEE.

Covid the Board System

The dark cloud of the vigorously spreading pandemic is still seen hovering over our heads. Though the situation presently seems under control, a continuation of the same is not guaranteed. The massive disturbance to the environmental assets leading to the melting of polar ice caps, ozone depletion, global warming, etc., poses a towering threat to every surviving species. The most recently faced devastation by the people is the 'Corona' virus;a ginormous pandemic, which has affected people living in almost every nook and corner of the world. For which the primary steps were to wear a mask, maintain social distancing and sanitize almost every single thing that comes in physical contact with more than one human. This brings in a crucial technical catastrophe, the physical barrier to be maintained, and the face masks covering the face, making fingerprint and face recognition systems totally impractical. This demands a grave need for a situation-friendly technical solution. © 2022 IEEE.

Improved Accuracy in Speech Recognition System for Detection of Covid-19 Using K Nearest Neighbour and Comparing with Artificial Neural Network

The objective of this research is to recognize the speech signals for identifying the Covid-19 using K Nearest Neighbour (KNN) and comparing accuracy with an Artificial Neural Network (ANN). Speech recognition using KNN is considered as group 1 and Artificial Neural Network is considered as group 2, where each group has 20 samples. ANN is a machine learning program in which the input is processed by numerous elements and produces the output based on predefined functions. KNN is defined to find the relations between the query and pick the value closest to the query. These groups were analyzed by an independent sample T-test with 5% of alpha, and 80% of pretest power. ANN and KNN achieve an accuracy of 83.5% and 91.49% respectively (significance < 0.05). This analysis observed that KNN has significantly higher accuracy than ANN. © 2023, The Author(s), under exclusive license to Springer Nature Switzerland AG.